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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 

Listing of Claims: 

1 . (Currently amended) A method in a computer system for creating a 
composite electronic representation including presentation material information, the method 
comprising: 

scanning a paper document to generate an electronic representation of the 
document, the document including presentation material having text ; 

extracting a visual feature from the electronic representation of the document, the 
visual feature corresponding to at least a portion of the presentation material; 

accessing recorded information including at least one of audio and visual 
information recorded during a presentation of the presentation material, applying an optical 
character recognition (OCR) algorithm to the text to produce recognized text, and comparing the 
recognized text to the audio of the visual feature to the recorded information to determine a 
portion of the audio of the recorded information that matches the recognized text visual feature , 
whereby at least a portion of the recorded information matches a feature portion of the 
presentation material, and determining matching information for each matching portion of the 
recorded information and recognized text feature portion using a matching algorithm configured 
to map the recognized text visual feature to a portion of any of a plurality of recorded 
information that includes audio that matches the recognized text feature portion ; 

generating a user selectable object providing a user with access to the portion of 
the recorded information determined to match the recognized text visual feature , and inserting 
the user selectable object into the electronic representation of the document when the computer 
system locates a portion of the recorded information determined to match the recognized text 
visual feature , the computer system thus creating a composite electronic representation of the 
document including the user selectable object and metadata including the matching information, 
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the user selectable object being placed in a position associated with the extracted feature and 
allowing the user to access the portion of the recorded information as an embedded video link in 
the user selectable object by selecting the user selectable object, the user-selectable object being 
able to access the portion of the recorded information using the metadata in the composite 
document; and 

storing the composite electronic representation as a PDF, Hypertext Transfer 
Language (HTML), Flash or Word formatted document for access by the user or another user 
accessing the composite electronic document. 

2. (Previously presented) The method of claim 1 , further comprising 
determining association information for the recorded information that corresponds to the 
extracted feature. 

3. (Original) The method of claim 2, wherein the association information 
comprises time information and source information for recorded information. 

4. (Previously presented) The method of claim 2, further comprising 
associating the association information with the determined additional information in the 
composite electronic representation. 

5. (Previously presented) The method of claim 4, further comprising: 
receiving a selection of the determined additional information in the composite 

electronic representation; and 

using the association information for the determined additional information to 
access the recorded information. 

6. (Previously presented) The method of claim 1, further comprising 
accessing the recorded information using the determined additional information. 

7. (Original) The method of claim 6, further comprising displaying the 
accessed recorded information. 
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8. (Original) The method of claim 7, further comprising playing the accessed 

information. 

9. (Previously presented) The method of claim 1 , further comprising: 
performing at least one of emailing, printing, storing, and copying the created 

composite electronic representation. 

10. (Canceled). 

1 1 . (Original) The method of claim 1 , wherein the received electronic 
representation of the paper document includes notes taken by a user, wherein the created 
composite electronic representation includes the notes taken by the user. 

12. (Canceled). 

1 3 . (Previously presented) The method of claim 1 , further comprising 
determining a document that includes the recorded information using the extracted feature. 

14. (Previously presented) The method of claim 13, further comprising 
determining a portion of the document that includes the information corresponding to the feature. 

15. (Previously presented) The method of claim 1 , wherein the feature 
comprises an identifier to a location in the recorded information, wherein the information in the 
recorded information corresponding to the feature is determined using the identifier. 

1 6. (Original) The method of claim 15, wherein the identifier comprises at 
least one of a barcode and signature information. 

1 7. (Previously presented) The method of claim 1 , wherein receiving the 
electronic representation comprises receiving a scan of the document, the document being a 
paper document. 
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1 8. (Previously presented) The method of claim 1 , wherein receiving the 
electronic representation comprises determining an electronic image of the document, the 
document being a paper document. 

1 9. (Original) The method of claim 1 , wherein receiving the electronic 
representation comprises receiving the electronic representation in response to an input from a 
user indicating that the composite electronic representation should be created. 

20. (Original) The method of claim 1, wherein the document comprises a 
paper document. 

21 . (Currently amended) A method in a computer system for creating a 
composite electronic representation of a document using information , having audio content, 
recorded during a presentation, the method comprising: 

scanning a paper document having text to generate an electronic representation of 
the document for the presentation , the electronic representation including a visual feature that 
was presented during the presentation ; 

extracting the visual feature applying an optical character recognition (OCR) 
algorithm to the text from the electronic representation to generate OCR determined text ; 

accessing recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
visual feature OCR determined text to the audio of the recorded information to determine a 
portion of the recorded information that matches the visual feature OCR determined text , the 
matching algorithm configured to map the visual feature OCR determined text to a portion of 
any of a plurality of recorded information having audio that matches the feature portion and 
generate matching information in response thereto; 

generating composite information based on the portion of the recorded 
information having audio that corresponds to the visual feature and OCR determined text in the 
electronic representation of the document; 
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generating a user selectable object providing a user with access to the portion of 
the recorded information corresponding to the visual feature OCR determined text , and inserting 
the user selectable object and metadata including the matching information into the electronic 
representation of the document when the computer system locates a portion of the recorded 
information corresponding to the visual feature OCR determined text , the computer system thus 
creating a composite electronic representation of the document including the user selectable 
object and the metadata, the user selectable object being placed in a position associated with the 
extracted feature OCR determined text and allowing the user to access the composite information 
in an application displaying the composite electronic representation or a separate application by 
selecting the user selectable object, the user-selectable object being able to access the portion of 
the recorded information using an embedded video link in the user selectable object; and 

storing the composite electronic representation as a PDF, HyperText Transfer 
Language (HTML), Flash or Word formatted document for access by the user or another user 
accessing the composite electronic document. 

22. (Currently amended) The method of claim 2 1 , further comprising 
determining association information for the recorded information that corresponds to the feature 
OCR determined text . 

23. (Currently amended) The method of claim 22, wherein the association 
information comprises time information for the recorded information, the time information 
indicating a time when information related to the feature OCR determined text was presented 
during the presentation. 

24. (Previously presented) The method of claim 23, further comprising: 
using the association information for the determined information in the composite 

electronic representation to access recorded information for the presentation at a time indicated 
by the time information. 
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25 . (Previously presented) The method of claim 2 1 , further comprising 
accessing recorded information using the determined composite information. 

26. (Original) The method of claim 25, further comprising displaying the 
accessed recorded information. 

27. (Original) The method of claim 26, further comprising playing the 
accessed information. 

28. (Canceled). 

29. (Previously presented) The method of claim 21 , further comprising 
performing at least one of emailing, printing, storing, and copying the created composite 
electronic representation. 

30. (Original) The method of claim 21 , wherein the document comprises a 
paper document. 

3 1 . (Currently amended) The method of claim 2 1 , wherein the feature OCR 
determined text comprises an identifier to a location in the recorded information, wherein the 
information in the recorded information that corresponds to the feature OCR determined text is 
determined using the identifier. 

32. (Original) The method of claim 3 1 , wherein the identifier comprises at 
least one of a barcode and signature information. 

33. (Original) The method of claim 21, wherein receiving the electronic 
representation comprises receiving the electronic representation in response to an input from a 
user indicating that the composite electronic representation should be created. 
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34. (Currently amended) A computer program product stored on a computer- 
readable medium for creating a composite electronic representation, the computer program 
product comprising: 

code for scanning a paper document having text to generate an electronic 
representation of the document, the document including presentation material; 

code for extracting a visual feature applying an optical character recognition 
(OCR) algorithm to the text from the electronic representation of the document to generate OCR 
determined text , the OCR determined text visual feature corresponding to at least a portion of the 
presentation material; 



information recorded during a presentation of the presentation material, and comparing the OCR 
determined text visual feature to the recorded information to determine a portion of the audio of 
the recorded information that matches the OCR determined text visual feature , whereby at least a 
portion of the recorded information matches a feature portion of the presentation material, and 
determining matching information for each matching portion of the audio of the recorded 
information and the OCR determined text feature portion using a matching algorithm configured 
to map the OCR determined text visual feature to a portion of any of a plurality of recorded 
information having audio that matches the OCR determined text feature portion ; 



portion of the recorded information determined to match the OCR determined text visual feature , 
and inserting the user selectable object and metadata including the matching information into the 
electronic representation of the document when the computer system locates a portion of the 
audio of the recorded information corresponding to the OCR determined text visual feature , the 
computer system thus creating a composite electronic representation of the document including 
the user selectable object, the user selectable object being placed in a position associated with the 
OCR determined text extracted feature and allowing the user to access the portion of the 
recorded information in an application displaying the composite electronic representation or a 
separate application by selecting the user selectable object, the user-selectable object being able 



code for accessing recorded information including 



audio and visual 
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to access the portion of the recorded information using an embedded video link in the user 
selectable object; and 

code for storing the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

35. (Currently amended) The computer program product of claim 34, further 
comprising code for determining association information for the recorded information that 
corresponds to the OCR determined text extracted feature . 

36. (Previously presented) The computer program product of claim 35, further 
comprising code for associating the association information with the determined additional 
information in the composite electronic representation. 

37. (Previously presented) The computer program product of claim 36, further 

comprising: 

code for receiving a selection of the determined additional information in the 
composite electronic representation; and 

code for using the association information for the determined additional 
information to access the recorded information. 

38. (Previously presented) The computer program product of claim 34, further 
comprising code for accessing the recorded information using the determined additional 
information. 

39. (Previously presented) The computer program product of claim 34, further 

comprising: 

code for performing at least one of emailing, printing, storing, displaying, playing, 
and copying the created composite electronic representation. 

40. (Canceled). 
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41 . (Previously presented) The computer program product of claim 34, 
wherein the received electronic representation of the document includes notes taken by a user, 
wherein the created composite electronic representation includes the notes taken by the user. 

42. (Canceled). 

43. (Original) The computer program product of claim 34, wherein the 
document comprises a paper document. 

44. (Currently amended) A computer program product stored on a computer- 
readable medium for creating a composite electronic representation of a document having text 
using information recorded during a presentation, the computer program product comprising: 

code for scanning a paper document to generate an electronic representation of the 
document for the presentation, the electronic representation including text a visual feature that 
was presented during th e presentation ; 

code for extracting the visual feature applying an optical character recognition 
(OCR) algorithm to the text from the electronic representation to generate OCR determined text ; 

code for accessing recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
OCR determined text visual feature to the audio of the recorded information to determine a 
portion of the recorded information that matches the OCR determined text visual feature , the 
matching algorithm configured to map the OCR determined text visual feature to a portion of 
any of a plurality of recorded information with audio that matches the OCR determined text 
visual feature and generate matching information in response thereto; 

code for generating composite information based on the portion of the recorded 
information that corresponds to the OCR determined text visual feature and the electronic 
representation of the document; 

code for generating a user selectable object providing a user with access to the 
portion of the audio of the recorded information corresponding to the OCR determined text 
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visual feature , and inserting the user selectable object and metadata including the matching 
information into the electronic representation of the document when the computer system locates 
a portion of the recorded information corresponding to the OCR determined text visual feature , 
the computer system thus creating a composite electronic representation of the document 
including the user selectable object and the metadata, the user selectable object being placed in a 
position associated with the text extracted feature and allowing the user to access the composite 
information in an application displaying the composite electronic representation or a separate 
application by selecting the user selectable object, the user-selectable object being able to access 
the portion of the recorded information using an embedded video link in the user selectable 
object; and 

code for storing the composite electronic representation as a PDF, Hypertext 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

45. (Currently amended) The computer program product of claim 44, further 
comprising code for determining association information for the recorded information that 
corresponds to the text extracted feature . 

46. (Currently amended) The computer program product of claim 45, wherein 
the association information comprises time information for recorded information, the time 
information indicating a time when information related to the text extracted feature was 
presented during the presentation. 

47. (Previously presented) The computer program product of claim 46, further 

comprising: 

code for using the association information for the determined composite 
information in the composite electronic representation to access recorded information for the 
presentation at a time indicated by the time information. 

48. (Canceled). 
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49. (Previously presented) The computer program product of claim 44, 
further comprising code for performing at least one of emailing, printing, storing, displaying, 
playing, and copying the created representation. 

50. (Original) The computer program product of claim 44, wherein the 
document comprises a paper document. 

5 1 . (Currently amended) A data processing system for creating a composite 
electronic representation, the data processing system comprising: 

a processor; 

a memory coupled to the processor, the memory configured to store a plurality of 
modules for execution by the processor, the plurality of modules comprising: 

logic to scan a paper document to generate an electronic representation of the 
document, the document including text and presentation material; 

logic to apply a optical character recognition (OCR) algorithm to the text extract a 
visual feature from the electronic representation of the document to generate OCR determined 
text , the OCR determined text visual feature corresponding to at least a portion of the text and 
presentation material; 

logic to access recorded information including at least one of audio and visual 
information recorded during a presentation of the presentation material, and compare the OCR 
determined text visual feature to the recorded information to determine an audio portion of the 
recorded information that matches the OCR determined text visual feature , whereby at least a 
portion of the recorded information matches a feature portion of the presentation material, and 
determining matching information for each matching portion of the recorded information and 
OCR determined text feature portion using a matching algorithm configured to map the OCR 
determined text visual feature to a portion of any of a plurality of recorded information having 
audio that matches the OCR determined text visual feature ; 

logic to generate a user selectable object providing a user with access to the 
portion of the recorded information corresponding to determined to match the OCR determined 
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text visual feature , and inserting the user selectable object and metadata including the matching 
information into the electronic representation of the document when the computer system locates 
a portion of the recorded information corresponding to the OCR determined text visual feature , 
the computer system thus creating a composite electronic representation of the document 
including the user selectable object, the user selectable object being placed in a position 
associated with the OCR determined text extracted feature and allowing the user to access the 
portion of the recorded information in an application displaying the composite electronic 
representation or a separate application by selecting the user selectable object, the user-selectable 
object being able to access the portion of the recorded information using an embedded video link 
in the user selectable object; and 

logic to store the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

52. (Currently amended) The data processing system of claim 5 1 , further 
comprising logic to determine association information for the recorded information that 
corresponds to the text extracted feature . 

53. (Previously presented) The data processing system of claim 52, further 
comprising logic to associate the association information with the determined additional 
information in the composite electronic representation. 

54. (Previously presented) The data processing system of claim 53, further 

comprising: 

logic to receive a selection of the determined additional information in the 
composite electronic representation; and 

logic to use the association information for the determined information to access 
the recorded information. 
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55. (Previously presented) The data processing system of claim 5 1 , further 
comprising logic to access recorded information using the determined additional information. 

56. (Previously presented) The data processing system of claim 5 1 , further 

comprising: 

logic to perform at least one of emailing, printing, storing, displaying, playing, 
and copying the created composite electronic representation. 

57. (Canceled). 

58. (Previously presented) The data processing system of claim 5 1 , wherein 
the received electronic representation includes notes taken by a user, wherein the created 
composite electronic representation includes the notes taken by the user. 

59. (Canceled). 

60. (Original) The data processing system of claim 5 1 , wherein the document 
comprises a paper document. 

61 . (Currently amended) A data processing system creating a composite 
electronic representation of a document using information recorded during a presentation, the 
data processing system comprising: 

a processor; 

a memory coupled to the processor, the memory configured to store a plurality of 
modules for execution by the processor, the plurality of modules comprising: 

logic to scan a paper document to generate an electronic representation of the 
document for the presentation having text , the electronic representation including a visual feature 
that was presented during the presentation ; 

logic to apply an optical character recognition (OCR) algorithm to the electronic 
representation to generate OCR determined text extract the visual feature from ; 



Page 14 of 18 



Appl. No. 10/813,901 PATENT 
Amdt. dated April 20, 2010 

Amendment under 37 CFR 1.116 Expedited Procedure 
Examining Group 2176 

logic to access recorded information including at least one of audio and visual 
information recorded during the presentation, and using a matching algorithm to compare the 
OCR determined text visual feature to the audio of the recorded information to determine a 
portion of the recorded information that matches the OCR determined text visual feature , the 
matching algorithm configured to map the OCR determined text visual feature to a portion of 
any of a plurality of recorded information having audio that matches the OCR determined text 
feature portion and generate matching information in response thereto; 

logic to generate composite information based on the audio of the portion of the 
recorded information that corresponds to the OCR determined text in visual feature and the 
electronic representation of the document; 

logic to generate a user selectable object providing a user with access to the 
portion of the recorded information corresponding to the OCR determined text in visual feature , 
and inserting the user selectable object and metadata including the matching information into the 
electronic representation of the document when the computer system locates a portion of the 
recorded information corresponding to the OCR determined text in visual feature , the computer 
system thus creating a composite electronic representation of the document including the user 
selectable object and the metadata, the user selectable object being placed in a position 
associated with the extracted feature and allowing the user to access the composite information 
in an application displaying the composite electronic representation or a separate application by 
selecting the user selectable object, the user- selectable object being able to access the portion of 
the recorded information using an embedded video link in the user selectable object; and 

logic to store the composite electronic representation as a PDF, HyperText 
Transfer Language (HTML), Flash or Word formatted document for access by the user or 
another user accessing the composite electronic document. 

62. (Previously presented) The data processing system of claim 61 , further 
comprising logic to determine association information for the recorded information that 
corresponds to the feature. 
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63. (Previously presented) The data processing system of claim 62, wherein 
the association information comprises time information for recorded information, the time 
information indicating a time when information related to the feature was presented during the 
presentation. 

64. (Previously presented) The data processing system of claim 63, further 

comprising: 

logic to use the association information for the determined composite information 
in the composite electronic representation to access the recorded information for the presentation 
at a time indicated by the time information. 

65. (Canceled). 

66. (Previously presented) The data processing system of claim 61, further 
comprising logic to perform at least one of emailing, printing, storing, displaying, playing, and 
copying the created representation. 

67. (Original) The data processing system of claim 61 , wherein the document 
comprises a paper document. 

Claims 68-69. (Canceled). 
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